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ABSTRACT 

Portfolio assessment, a technique traditionally used 
with elementary and secondary students, involves the presentation of 
a collection of individual work documenting the learner's efforts, 
progress, and achievement. Recently, it has been suggested that 
portfolio assessment be broadened in its application to include 
teacher hiring and evaluation. The types of documents suitable for 
teacher portfolios include teaching documents, instructional 
materials, samples of student work, academic products related to 
teaching, and personal documents. Elementary and secondary 
administrators and teachers in both general and special education 
were surveyed on the use of portfolios in teacher hiring and 
evaluation. At least 75 percent of respondents were from rural or 
small schools in Oklahoma, Utah, and New Mexico. Portfolio assessment 
was perceived as being a positive addition to the teacher hiring 
process. In addition, both teachers and administrators supported the 
use of portfolios in teacher evaluation. Teachers favored the 
uniqueness, empowerment, and self-evaluative control involved in 
portfolio assessment. Respondents showed moderate levels of knowledge 
concerning the portfolio process. Greater knowledge is needed, 
though, about portfolio processes such as establishing goal 
statements and reflections, early documentation to demonstrate 
professional growth over time, and appropriate products of teaching 
portfolios. Appendix includes suggestions for contents of teacher 
portfolios. (LP) 
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PORTFOLIO ASSESSMENT IN TEACHER EVALUATION: A COMPARISON OF THE 
PERSPECTIVES OF GENERAL AND SPECIAL EDUCATION ADMINISTRATORS AND 

TEACHERS 

PortfoUo assessment is one of the latest entries into the movement toward "authentic*' assessment designed to 
close the perceived theory-practice gap in education. ffistoricaUy used with elementary and secondary students m 
specific content areas, s)ich as reading or writing, its use is currently broadening in its applications to other content 
areas and expanding into other age groups. Teacher education programs have recenUy employed vanous strate^es 
to go beyond preparing teachers for the appropriate classroom use of portfoUo assessment to providmg a model for 
using a portfolio for the evaluation of individual teacher's professional development The purpose of this paper is 
to report the results of an exploratory study of the attitudes held by general and special education admmistrators 
and teachers toward the use of portfolio assessment for teacher evaluation. 

The portfolio, a newly favored technique, is a coUecUon of individual work that documents the learners 
efforts, progress and acliicvcment (Arter & Spandel, 1992). The portfolio can take on many forms, some of which 
are reviewed for efficacy herein. 

Portfolio assessment used with teachers encourages choice, revision, and reflection related to their own work. 
It gives them a basis for displaying their best efforts and forms the foundation for professional development. In 
addition to its potential effectiveness for teachers, the portfolio is often advocated because »t may provide public 
school administrators an organized product which documents a teacher's abilities and professional excellence. 
According to Cole and Uphoff (1992), this provides evidence of how the job candidate operates as a thinkmg. 
problem-solving, self-evaluating professional. Bird (1990) asserts that portfoUo docuraentaUon will Provide 
important information in hiring decisions such as teacher plans, examples of developed matenals, tests and the 
like In fact, several states require that portfoUos be used as part of the teacher evaluation process (e.g., 
Furiwengler. 1985; Terry & Eade, 1983). Stemnier, Brown and Smith (1992) note that employers are now 
demanding evidence that those people they employ can. get the job done. These authors raise the wncem Lhat 
students might put materials together that may not be employer relevant. This issue became one of several 
addressed from the teachers' perspective in this research. 

-* * PortfoUo assessment is used when assessment must be dynamic. When change and developmem is needed to 

assess the potential of future employees, the richest portrayal of performance in action is based on the data in a 
^ ' portfolio The portfoUo in this dynamic sense is based on many different sources of inforraauon, collected over 

<y> thne, in authentic settings. The portfolio reflects the important activities that take place in classrooms. It is 
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believed that the best person to detenninc what is important is the teacher. The portfoUo framework provides 
teacher with a purpose and a struoure for keeping and sharing their work. It may lead to mentoring, coUegial 
interatt ons, and reflections on the teaching process as well ( Wolf; 1991). 

A thors argue about the components that belong in the teacher portfoUo. Some specify general categories 
(Ba.-'OD & Collins, 1993), others advocate for the inclusion of domains of interest (Gciger & Shugarman, 1988; 
Ryan & Kuhs (1993), and still others prefer to iiaclude evidence of various processes that take place (Uibach, 
1992). Some ofthese components are detailed in Table 1, Ppsjit>li? Cgntgnts cf Portfolio?: Syggggtions From 
Various Authors . An examination of this table brings up several unportant points. A portfoUo must clearly define 
the teacher's area of expertise, the contexts in which cxcjUency has been demonstrated, and the groups of students 
taught. AdditionaUy, a portfoUo can document experiences with student differences, such as diversity in ethnicity, 
language, economics or abiUty. 

Table 2 presents a more formal approach to the generation of portfoUo contents. This table was derived from 
Bird (1990) and contains significant detail to account for the pos-sible components in a portfoUo. 

Finally, portfoUos must contain tangible products. One attempt at defining these products is provided in 
Table 3 abstracted from Urbach (1993) and supplemented by authors of this paper. This listing is illustrative but 
not comprehensive or exhaustive. It reflects examples of die current tiiinking in die field about what constitutes 
the portfolio. 

Given Uie diversity of potential products to include in a portfolio and Uie multiple ways in which a portfolio 
might be used, there appears to be a need to develop baseUne data regarding the form and fimction of portfoUo 
assessments according to principals and superintendents. AdditionaUy, tiiere may be a discrepancy between tiie 
ideas of teachers and tiiose who hired them regarding appropriate content and use of portfoUos. Otiier differences 
may exist between general and special educators and rural and urban school needs. 

One of the reasons for differentiating between general and special administtators relative to Uieir perceptions 
of portfoUo components is tiie differences they may have in the context for teaching. The general and special 
teacher are perceived by many to have different roles, and to some extent, tiiese differences are reflected m tiieir 
uaining. These perceptual and tiaining differences lead to a different context in which artifacts are produced The 
contextual differences are veiy important to identify so tiiat one reaUzcs how tiie contexts inform tiie possibUities. 
The need for a contexttial understanding has led ColUns (1991) to state tiiat proper interpretation of a portfolio 
requires tiie inclusion of a professional biography, a description of tiie school and community setting, and a 
description of tiie school environment. AdditionaUy, a cUent description for tiie kind(s) of special needs children 
who are involved may be a necessary inclusion. 

The purpose of this study was to compare general education administrators (principals and superintendents) 
with special education administrators and special education teachers to see if tiiere were differences in terras of 
their (a) knowledge of portfolio assessment, (b) attitiides toward tiie use of portfolio assessment, (c) beliefs about 
its use in hiring decisions, (d) tiie place of creativity in portfolio assessment and (e) tiie potential components tiiat 
might be included in an academic employment portfolio for teachers. 



Method 

This study was an expansion of data collected as a pUot study on assessment techniques and issues at tiie 
college level. Funded in part by tiie Oklahoma State Board of Regents, a comprehensive competency-based 
assessment project was launched at a large land-grant university. Multiple committees were formed to condurt 
preliminary studies on various techniques. One study was tiie investigation of tiie perceptions of admimstrators 
regarding tiie use and stiucturc of portfoUos in teacher education. The detaUs of tiiis preliminary study have been 
reported in Coombs and BuU (1994). Adaptations of tiie instnmient and an expansion of tiie population allowed 
the exploration of tiie research questions for tiie present study. 
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Instruments 



The instrument used in the Coombs and BuU (1994) study was adapted into several forms for use in this 
study. It contained items about knowledge and attitudes related to portfolio, the relationship of Uie portfolio to the 
hiring decision, the relationships witli creativity and risk-taking behaviors and an assessment of the desirability of 
components as parts of the teaching portfolio. To generate the produa list for potential components, 47 faculty 
were surveyed as were 363 undergraduate students in teacher education classes. Their comments as well as 
examples from the literature were used to generate the portfolio components list 

Several forms of the instrument were needed for this study. In the Oklahoma sample, the questionnaire was 
split into two parts. This division was necessary because the questionnaire was sent by mail and the length of a 
survey instrument is known to effect the response rate. The participants in Utah and New Mexico were given the 
entire instrument 

The response rate for the Coombs and Bull (1994) core study was 40% (by mail questionnaire). Response 
rates for instruments collected in classes were nearly 100% and an 84% response rate was achieved with 
administrators at the New Mexico statewide special education meeting. 

Sample 

The various samples for the study were: elementary and secondary principals and superintendents, randomly 
selected from a list of ail such officials in Oklahoma. Details of this sample arc reported in Coombs and Bull 
(1994); Oklahoma special education administrators and teachers who were enrolled in classes at Oklahoma State 
University during the spring semester of 1994; Utah administrsiors and teachers who were enrolled in classes at 
the University of Utah during the spring semester of 1994; and New Mexico special education administrators who 
completed the questionnaire at a statewide special educauon meeting. At least seventy-five percent (75%) of all 
respondents were from rural or small schools. 

Data were analyzed using a S AS program for personal computer. ANOVA procedures were conducted for 
between groups comparisons (1x3 analysis of variance by item). Descriptive statistics were calculated for items 
by groups. 



Results 

There arc five sets of questions on the fiill and extended instrument. The first question set dealt with portfolio 
assessment and the hiring decision. Results indicate general agreement among teachers, special education 
administrators and general administrators that portfolio assessment: (1) will provide hiring information not 
available using other methods, (2) is not too Ume consuming, (3) can be understood by school boards, and (4) can 
be used by administrators. Upon examination of the ANOVA results, special education administrators were more 
likely to strongly disagree than general administrators and teachers (F^^, 7.34, p > .007) with the notion that a 
resume or curriculiun vita is enough information to make an adequate hiring decision. One hundred percent of 
both general and special education administrators agree that portfolio assessment should be used as part of the 
teacher hiring decision. 

The second set of questions contains items regarding perceptions of portfolio assessment in terms of 
uniqueness, creauvity, risk taking, problem identification, and the degree to which teachers need to conform for 
comparison. The results indicate only three differences: (I) administrations were more willing to compare 
teachers to each other than were teachers (F^, 3.59, p > .029); (2) teachers wanted to include more unique 
material in the portfolio assessment (F^ 3.20, p > .042); and (3) administrators thought there was more 
rink-taking exhibited by teachers in the use of portfolio assessment (F^ 3.88, p > .022). 




The third question set was used with special education teachers and general administrators only. The 
questions assessed attitudes tow^d poitfoUo assessment Typical content of these items related to preferences for 
the portfolio process, beUefs toward the worth of portfolio assessment, perceptions of choice in portfolio use, 
potential for risk-taking, fairness of portfolio assessment, empowerment, and so fortk There were only two 
differences between teachers and administrators: (1) administrators favored over teachers the belief that portfolio 
assessment helps administrators (F,,,, 5.82, p > .017), and (2) teachers favored the belief that portfoUo assessment 
helps teachers be more reflective (F, i„ 8.91, p > .003). 

The fourth set of questions contains items related to cognitive knowledge about portfolios. These items 
presented recommendations from the Uterature for portfoUo development using a Likert-like format to which 
respondents were asked to agree or disagree. Items that scored in the range of neutral or the opposite direction 
would rate as areas the subjects felt were unclear or they misunderstood the use of portfolio assessment. The 
foUov/ing items were those that scored in the neutral to opposite range 2.5 - 3.5: 

• Each portfolio component must have a goal statement and a reflection (an analysis of whether or not 
the teacher believes that the goal has been met). 

. If the beginnings of a portfolio are too brief or incomplete, it is impossible to show growth or change 
over time. 

Portfolios are not designed to help teachers become more articulate. 

• There arc four classes of evidence that can be included in portfolios: artifacts, productions, 
attestations, and reproductions. 

. Portfolios should not be used to determine tiie efficiency of a teacher's instruction in a given area (as 
shown by student products). 

A portfolio is seldom a systematic compilation of a teacher*s work. 
. Portfolios should not contain multiple examples of similar activities to provide repeated observations. 
Portfolio assessment is free of gender and culture bias. 
The major components of a good portfolio should not be work samples. 
Results indicate significant differences between special education teachers and general administrators in 
relation to: 

. (1) importance of portfolio goal statements and reflections - administrators i-ated as more important 
(F,,5, 8. 12, p>. 005), 

. (2) uniqueness and self-evaluation of teachers - rated higher general education administrators (F, 
12.04, p > .007), 

(3) use of portfolio for self-evaluation - teachers rated agreement higher (F, 6.37, p > .013), 

(4) use of portfolio assessment to determine teacher efficiency - greater administrator agreement (F, ,55 
4.33, p>. 039), 

(5) teachers - developed portfolio assessment objectives - teachers agreed more (Fi.iw '^•33, p > 039), 
. (6) teachers should set criteria for inclusion in portfolio assessment - teachers agree more (F,,i«> 

18.48, p>. 0001), and 

. (7) teacher empowerment as a major purpose of portfolio assessment - teachers rated higher (F,.,«> 
5.92, p>. 016). 

The fifth set of questions contains items that were ranked by respondents as necessary to be included in 
portfolios. The ten top-ranked items recommended by regular administrators (in ranked order, from tiie top) arc: 
(1) classroom management system, (2) (tied) multi-media presentations(s), (2) (tied) resume/vita. (4) (tied) 
autobiographical sketch/statement about teaching :ihilosophy, (4) (tied) administrator evaluations of 
capabilities/products, (6) letters of recommendation. (7) (tied) list of extra curricular activities, (7) (tied) list of 
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objectives for content area, (9) description of what I want to teacli, (10) lesson plan(s). The top ten items 
recommended by special education administrators (in rank order, top to bottom) arc: (1) letters of 
recommendation, (2) administrator evaluations of capabiliUes/products, (3) (tied) resumeMta, (3) (tied) professor 
evaluations of capabilities/products, (5) autobiographical sketch/statement about teaching, philosophy (6) 
description of why I want to teach, (7) descripUon of related experiences, (8) list of teacher assisting/aiding 
acUviUes, (9) classroom management system, (10) (tied) selfi'peer assessment, (10) (Ued) acUvity file. The top ten 
items recommended by special education teachers (in rank order, top to bottom) are: (1) (tied) letters of 
rccommcndaUon, (1) (tied) adapted materials (to meet the needs of diverse students), (3) (Ued) autobiographical 
sketch/statement of teaching philosophy, (3) (Ued) descripUon of related experience, (5) classroom management 
systems (6) multi-media presentaUon(s), (7) case study write ups (analysis of case study), (8) admimstrator 
evaluaUons of capabiliUes/products, (9) (Ued) pracUcal/appUed paper(s), (9) (Ued) list of objectives for content 
area. 



Conclusions 

Generally, portfolio assessment is perceived as being a positive addition to the hiring process of teachers, boUi 
by general and special education administtators. Adnunistrators of both categories axe in total (100%) support of 
the use of portfolio teacher evaluation. There are various positive attimdes toward tiie use of portfolios and toward 
the underlying assumptions of portfolio tiieory. Teachers favor tiie uniqueness, empowerment and self-evaluaUve 
control; whereas, administrators do not score in tiie opposite directions so Uiey too indicate support for tiiis part of 
the model. 

Respondents showed moderate level of knowledge about Uie portfolio process. More knowledge seems to be 
needed in relation to goal statements and reflections, Uie need for beginning documentation (to show growtii over 
time), the four classes of evidence, wheUier portfolios can be used to provide evidence of efficiency, wheUier 
portfolios should contain multiple examples of similar activities, wheUier tiiey are gender and culmre bias free, and 
the place of work samples in tiie portfolio. These would make ideal content for a staff development/inservice 
program for administrators. 

Another interesting outcome comes in tiie rank ordering of what is considered important for each of tiie three 
respondent groups. Comparing special education administrators and teachers tiiere are only four products common 
in the top ten: letters of recommendation, autobiographical sketch/phUosophy, administrator evaluations and 
classroom management systems. When comparing regular administrators and special teachers, tiiere were two 
additional correspondences, list of objectives for coment area instru(^on and multi-media presentation(s). This 
would indicate tiiat tiiere is room for more instruction and training of teachers in tenns of providing tiie 
appropriate products as part of teaching portfolios. There may also be ^leed for training administrators on tiie 
variety provided by lower ranked products. This awareness may lead to useful infonnation in admimstrative 
decision making. 

These data are particularly useful as initial baseline measures for schools in rural areas because tiuee quarters 
of the sample came from nual areas in rtiral states. The data also provide indications to teachers of tiie kinds of 
infonnation typically sought by administrators in tiie evaluation of portfolios of special education teachers. We 
recommend tiiat tins data be shared witii preservice students and inservice teachers who are using portfolios as part 
of the hiring process. 

The results of tins study are exploratory, so caution is necessary when interpreting tiie application for use of 
portfolios for student teacher evaluation. Practicing teachers and tiiose entering tiie field may find tiie vanabilm- of 
ihese results helpful and may want to insure tiiat tiie portfolios tiiey develope wiU meet tiie trends discovered 
herein. 
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Table 1 

POSSIBLE CONTENTS OF PORTFOLIOS: SUGGESTIONS FROM VARIOUS 



AUTHORS 

Barton & Collins (1993> : 

Artifacts: Things produced as part of the normal work, e.g., field notes 

Reproductions: Documents describing typical events which describe the work of the portfolio developer 

Productions: Documents which have been prepared particularly for tlie portfolio, e.g., goal statements, 
reflections, and captions 

Attestations: Descriptions of the developer's work wliich are created by others, e.g., recommendations o 
evaluations 

Rvan & Kuhs (1993) : 

Domains of knowledge and performance 

Knowledge of subject matter 

Intellectual abilities and problem-solving skills 

Pedagogical skills 

Curriculum knowledge, insight and skill 
Knowledge about learners and learning 
Geiger & Shugarman (1988) ; 

Evidence of professional responsibility 
Conunand of the subject matter 
Content-specific pedagogy 
Class organization and management 
Student-specific pedagogy 
Urbach (1992) ; 

Topics taught 
Methods used to teach 

Changes in teaching and coursework 

Rigor in academic standards 

Student impressions of teaching effectiveness 

Student impressions of their learning 

Efibrts at developing teaching skills 

Assessinent of teaching by colleagues 



166 8 



s 

u 
o 



a 
r 

o 



o 
e 



O 

a. 

•c 

Si 



o 



o 



o 



a 

f 

o. 
B 



•n 

1 1 

ill CO 



a! 8. 



s 



B ^ 



i3 

O 



CO 00 

o c 



3 

a 
o 



"S *n 



B C4 
o > 



(i> 



3 



CJ 

03 



s 
s 



-a V3 

'Eb.S 
=: o 



1 

3 



= T3 

03 2 



O 

ui 

•s 

8 

1 i 

IS O 



3 



3 

«3 



C 

o 

i 

< 



c 

o 



o 

u 



■s 

CJ 



U3 



o 

ON 
OS 



T3 
ffl 

E 
o 

O 



ERIC 



167 



-J 
O 

Es. 
H 
SC 

O 
& 

as 
O 

CO 

H 
U 
< 

H 

Q 
Z 
< 

c- 

Z 

u 
o 

o 

(/5 
U3 
CU 

> 

CO 





1 








i 






livity* 


slagc/j 


ing Aci 


is 

puppet 

.til WD 



£ 

o 



o 



W5 

CO O 

< a 



- X o 2 
2; o 3 

a: CO ^ X 



*u5 
O 



o 



T3 



•n > 
-2 2 --o 



o c „ i: 3 
2 5: ^ g 2 S 
U < H a: Q O 




CD 

a 

§ 

b 
o 
a 

c 
1-4 
43 
o 

&4 



e 

o 

tn 



re 



&5 i2 



E 



5? .2 g s 



3 1- 



3 
-J 0 



^ to 




re ^ - — ; 

=. vj 

w ^ ty5 



o a. 

^ C/l 



^ 2 



^ ♦ g 

so "O 5^ o 

re re ^ 52 

5 5 S S o 

0.5 g- o ^ 

C o u a. 3 

«^ s re c 

— 52 3 O .5 

C/D ^ Ca O < C/5 



DO 
C 



» 

"O CO 



C/3 
CO 

o 

Si 0-2 

re :^ x: 
CL > Q- < 



>> 

re 
C 
re 



3 



U 

Id 

EH 

O 

0) 
4J 

iH 
Q> 
OS 

(» 

o 
7i 
•o 
o 
VI 

P4 

o 

Id 

o 



o 

^ 2 

^ i 

I i 

^ re 

' O 3 

o ^ 

E. ^ 

■H ^ 



Si- t> 
re 

D. ^ 

o c 



re »— 
re X 



^ 2 

o S .Si 

a: Cl, 11. 



o re 

> =^ 

H b 
8 

re ^ 



IB 



re 



3 re 

3 



ERIC 



168 



o o 

'•2 o 

a, ;;;; 

a CO 

3 * 



5 



00 Q 



♦ :2 

.2 t5 

I 8 

el 

S 3 

W Ui 

o g 



5^ 



0) 



" re 
to 



a 
o 



S5 S 



S o o i- 



_ ^ o 

< < 



b5 



W S (U 

P4 < a 



OS 
OS 



o 

3 

2 

CL 

E 



.2 ^ t. 

m C 
§ O 5 

> 



o 

t/1 



Si 



Cil Q Q Cu c/D 



o 

U-i 



-a 
< 



E 

0) 



-a 

CO 

* 



cr: 



ERLC 



169 



